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Abstract 

In this paper, we apply the combinatorial proof technique of Description, Involution, 
Exceptions (DIE) to prove various known identities for the joint cumulant. Consider 
a set of random variables S = {X\, . . . ,X n }. Motivated by the definition of the joint 
cumulant, we define ^(S) as the set of cyclically arranged partitions of S, allowing us to 
express the joint cumulant of S as a weighted, alternating sum over 'W(S). We continue 
to define other combinatorial objects that allow us to rewrite expressions originally 
in terms of the joint cumulant as weighted sums over the set of these combinatorial 
objects. Then by constructing weight-preserving, sign-reversing involutions on these 
objects, we evaluate the original expressions to prove the identities, demonstrating the 
utility of DIE. 
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1 Introduction 



Let S = {Xi, X2, ■ ■ ■ , X n } be a set of random variables. Let &(A) refer to the set of 
partitions of set A into nonempty subsets, which we call blocks. So, for r G &(A), each 
(3 G r is a block. Then, the joint cumulant of the set of random variables S is defined to be 

K (s)=K(x 1 ,x 2 ,...,x n )= (-i) irhi (ki-i)!n E (n x )- 

The joint cumulant is a measure of how far random variables are from independence. Notice 
that if n = 1 or n = 2, the joint cumulant reduces to the expected value and covariance, 
respectively: 

k(X) = E(X), k{X, Y) = E{XY) - E(X)E(Y). 

The identities we prove here are all known results for the joint cumulant. The cumulant 
was first introduced by Thiele in [T] in 1899. Brillinger provides a history of the development 
of higher order moments and cumulants as well as their applications in |B3j . For another 
interpretation of most of these identities involving Mobius inversion by Speed, see [S] . 

In this paper, we use the combinatorial method of Description, Involution, Exception - 
DIE - a technique for evaluating alternating sums, to prove properties of the joint cumulant. 
We learned this technique from Prof. Arthur Benjamin at Harvey Mudd College, who intro- 
duced it in |B1J. Because the expressions we are evaluating are in terms of joint cumulants, 
which are in terms of expectation values, we use a version of DIE that proceeds as follows: 

• D (Description): Describe a combinatorial interpretation of the expression. Define a 
set C of combinatorial objects, a sign function s : C — > {—1, 1}, and a weight function 
W : C — > K. such that the sum can be written as 

• I (Involution): Find a weight-preserving, sign- reversing involution on a subset Cq C C. 
That is, find / : C — > Cq, such that for any p G Co, 

f(f(p)) = P, W(f(p)) = W(p), s(f(p)) = -s(p). 

• E (Exception): Determine the elements of C — Co, which we call exceptions. Then, 

J2s(p)W(p)= £ s(p)W(p). 

pec pec-Co 

The reason DIE works is simple: If we find such an involution /, then we can break up 
C into pairs (x,f(x)) such that s(x)W(x) and s(f(x))W(f(x)) cancel in the sum for all 
x G C , leaving us with the exceptions. Usually we describe the involution first and then 
give the exceptions. 

In order to use DIE to prove properties of the joint cumulant, we introduce a combinato- 
rial interpretation of the joint cumulant. We define ^(A) to be the set of cyclically arranged 
partitions of set A. That is, first partition A and then arrange the blocks of the partition 
into a cycle. In general, such an object a G ^(A) looks like: 
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where the $ G a are the blocks of the partition and \a\ is the size of the partition, or the 
number of blocks. Next, we define a weight function for 'tf(S). Let V : ^(S) — > R be given 
by 

/3g<t Vxe/3 / 

Note that V depends only on the partition, not the cyclic arrangment. For example, 




represents the partition {{^1, X4}, {X 2 , X 6 , X 7 }, {X 3 , X 5 }} arranged in the cycle 
({X 1 , X 4 }{X 2 , X 6 , X 7 }{X 3 , X 5 }), and its weight is 

E(X 1 X 4 )E(X 2 X 6 X 7 )E(X 3 X 5 ). 

Because there are (|r| — 1)! ways to arrange the blocks of r into a cycle, all with value 
n^g r ^ (lIxg/3 X ) ' we readily observe that 

<S) = £ (-1) H -V(a). 

a&g(S) 

This is our combinatorial interpretation of the joint cumulant. The set of combinatorial 
objects is ^{S), the sign function is s(a) = (— and the weight function is V(a) = 

Y[i3 €(7 E (^rixg/3 ^) • We wn l continue to use the above definition for ^(S) and V throughout 
this paper. Furthermore, we will define more sets and functions which we will continue to 
use throught the paper. 
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2 Joint Cumulant Identities 

Theorem 1. For n > 2, the sum of the coefficients in the joint cumulant is 0. 
Proof. (DIE) 

• D (Description): By definition of the joint cumulant, the sum of the coefficients is 

£ (-l)H- 1 (|r|-l)!= £ (-I)""" 1 . 

t£0>(S) aeV(S) 

Here, our set of combinatorial objects is ^(S), the sign function is s(a) = (— 1)'°"' _1 , 
and the weight function is 1. 

• I (Involution): In any cyclically arranged partition of S, either X\ is or is not alone in 
its block. If X\ is alone, there must exist a block after it as n > 2. Let / be the map 
that merges X\ into the next block in the cycle if X\ is alone and pulls X\ out of its 
block and puts it before that block if X\ is not alone. That is, let / map 




where Bi and B 2 are nonempty sets of random variables. Clearly, / is an involution 
and is weight-preserving as all weights are 1. It is also sign-reversing as it changes the 
number of blocks by ±1. 

• E (Exceptions): None. 

Therefore, the sum of the coefficients is 0. 

□ 

Theorem 2. Suppose n>2 and every proper subset of S is independent. Then, 

«(s)=E(n*) - ri E w- 

\X€S J xes 

Proof. (DIE) 
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• D (Description): As before, 

<S) = £ (-l) kh V(a). 

• I (Involution): Let / be the same involution as in Theorem [TJ Notice that each cyclic 
arrangment of the blocks a ^ {S} has weight 

v(°)=U E (ii x ) = ri E w 

because every proper subset of S is independent. Hence, / is weight-preserving for 
a ^ {S}, {{Xi}, {X 2 , X3 ■ • • X n }}. It is also sign- reversing as it changes the number of 
blocks by ±1. 

• E (Exceptions): We have two exceptions - {S}, with value E (Fixes ^) an< ^ s ^S n 
and its pair in the involution, {{Xi},{X 2 ,X 3 - ■ ■ X n }}, with value r] Xg>s ,E(X) and 
sign (-1). 

Therefore, 

k(S)=e(]Ix\ - l[E(X). 

\xes J xes 

□ 

For the next theorem, we will need the following defmtion. We say two sets of random 
variables M = {M 1 , M 2 , ■ ■ ■ M p } and N = {N x , N 2 , ■ ■ ■ N q } are independent if 

P(Mi = ai for all i, Nj = bj for all j) = P(M, = a* for all i)P{Nj = R, for all j). 

Furthermore, if M and N are independent, then for all Q C M, R C iV, 

K (n jf n y )= K fn jf ) K (n y )- 

VxeQ ye-R / VxeQ / \YeR J 

Theorem 3. If S can be partitioned into two nonempty, independent subsets, then 

k(S) = 0. 

Proof (DIE) 

• D (Description): As before, 

< s ) = E (-i) khl w- 
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• I (Involution): Let M = {M 1 , M 2 , • • • M p } and N = {N Xl N 2 , ■ ■ • N q } be a partition of 
S into two relatively independent subsets. Consider the block containing Mi. Starting 
from this block in the cycle, find the first block containing an element of N. Call this 
block B. Let C = B n M and D = B n N. Now, if C = 0, the previous block must 
have contained only elements of M, or else we would have found the desired block B 
sooner, as we started at a block containing M\. Then, let / be the following map: If 
C 7^ 0, pull out C from B and make it its own block in front of B. Otherwise, if C = 0, 
move the previous block into B. That is, let / map 












where C C M, D C iV are nonempty. Clearly, / is an involution. Because M and iV 
are relatively independent and P C M, Q C N, we have 

E fn x n y )= E fn x ) E fn r 

Also, / changes no other blocks besides those involving C and D. Hence, / is weight- 
preserving. It is also sign reversing since it changes the number of blocks by ±1. 

• E (Exceptions): None. 
Hence, 



k(S) = 0. 

To shorten notation, we will make the following definition. For r G &(S), define 

«(r) = IJ«C9)- 



□ 



Theorem 4. 



E (u x )= E <^ 



Proof. (DIE) 
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• D (Description): Consider the expression 



E «m= E n»w= E II E (-D'-'-'vw. 

Choose a partition r of 5. Then, for each j3 G r, we choose an element of ^{0). Let 
f^(»S) be the set of these combinatorial objects. For each p G £${S), we refer to each 
f3 G p as an outer block and each 7 G /3 as an inner block. Such an object looks like 




where the 7s are the inner blocks and the /3s are the outer blocks. Rewriting the sum 
using these new objects, 

E «oo = E IB- 1 )""" 1 ^)- 

tg^(s) P e9(s) pep 

Or, using our expression for the weight and distributing 

x; «(r)= e (-i)^i-wn n E (n*Y 

re^(5) p£i?(S) /36P7G/3 \X£7 / 

Thus, our set of combinatorial objects is S>(S), our sign function is 

s (p) = (-1)E^I/3|-IpI 5 

and our weight function is 

w(p)=nn E fn^- 

• I (Involution): Consider any p G @{S). Let 71, 72, ■■-,7m be the inner blocks of p 
ordered by increasing order of their minimum index. (This order is arbitrary, but we 
are explicit about the order because we need the order to be the same for all elements 
of Q){S) with the same inner blocks). Then, we write each cycle in terms of the inner 
blocks using cycle notation. We will keep the inner blocks the same and apply our map 
to the cycles. 

Now, either 7x and 72 do or do not lie in the same outer block or cycle. Let / be the 
map that merges the cycles containing 71 and 72 if they are not in the same cycle and 
splits the cycle containing both if they are in the same cycle. We split and merge these 
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cycles by adding or removing parentheses in cycle notation, respectively. That is, let 
/ map 

(7iC , i)(7 2 C 2 )(C 3 )(C 4 ) • • • (C k ) (7iC l72 C 2 )(C 3 )(C 4 ) • • • (C fc ) 

where each Q represents any sequence of inner blocks. Such merging and splitting is 
well defined because of the order of the cycle. Clearly, / is an involution. Notice that 
the weight function is 

771 / ^ 

w( p ) = 1[eI J]x 

i=l 

which depends only on the inner blocks. As / does not change the inner blocks, / 
is weight-preserving. Furthermore, / changes the number of outer blocks by ±1 and 
maintains the number of inner blocks, and we have the sign function (— l)^ep I^HpI_ 
Thus, / is sign-reversing. 

E (Exceptions): This involution is defined for any p with two or more inner blocks, so 
/ is not defined for any p with only one inner block, which also means that p has one 
outer block. Thus the only exception is p = {{S}}, with sign and weight 



s(p) = 1, W(p) = E J] X 
Therefore, 

□ 

For the next theorem, we will need to define a partial order, < ,on £P(S). For i\. r G 
&(S), we say that ir is finer than t, or 7r ^ r, if for all (5 G tt, there exists a G r such that 
/3 C a. Or, every block of tt is contained in a block of r. 

Theorem 5. For all r G ^(S), 

n E (n*)=5>w- 

Proo/. (DIE) 

• D (Description): Similarly to Theorem HI 

I>w = £n £ (-d'-'-vm. 

TT^T TT^T /3S7T crG C (f (,9) 

Let @(S) be defined as in Theorem HJ Choose a partition n oi S such that 7r ^ r. 
Then, for each (3 G tt, we choose an element of ^(/?). Let Sf T (S) C ^(S 1 ) be the set 
of these combinatorial objects. We continue to refer to inner and outer blocks as in 
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Theorem HI We have the same objects as in H] except the partition forming the outer 
blocks is finer than r. Then let W and s be defined as in Theorem HI Then, similarly 
to Theorem HI 

$>(tt) = £ <p) W (p)- 

• I (Involution): Let «i, . . . , a\ T \ be the blocks of r. Let p G & T {S). Now, each inner 
block is contained in an outer block, and each outer block is contained in a block 
of r by definition of @ T (S). Thus, each inner block is contained in a block of r. 
Let 7i ) i,7i,2) ■ ■ ■ , 7i,m be the inner blocks of p that are contained in ordered as in 
Theorem 0J Find the first i such that there is more than one 7y . Then let / be the 
same map as in Theorem 4, but just acting on the inner blocks with first index i. Let 
/ merge the cycles containing 7^1 and 7^2 if they are not in the same cycle and split 
the cycle containing both if they are in the same cycle. That is, let / map 

(7i,iCi) (72C 2 )(C 3 )(C4) • • • (C k ) (ji,2C ll2 C 2 )(C 3 )(C A ) ■ ■ ■ (C k ) 

where each Cj represents any sequence of inner blocks. Clearly, / is an involution. 
As before, the weight function depends only on the inner blocks. So, as / does not 
change the inner blocks, / is weight-preserving. Furthermore, / changes the number 
of outer blocks by ±1, and we have the same sign function as in Theorem HJ so / is 
sign-reversing. 

• E (Exceptions): This involution is defined as long as we have two or more inner blocks 
for some block of r. Thus the exception is the single p G @ T {S) for which each outer 
block contains one inner block, and the inner blocks are the blocks of r. For this 
exception, 

s(p) = l, W( P ) = 1[e(i[xY 

/3gt Xx ep J 

Therefore, 

£n<<«=Wn*)- 

■k<t /3ew per \xe/3 / 

□ 

For the next theorem, we will need the following definition. Let 

T = {X i j\ie[n] i je\j i ]} 

be a set of random variables, where [n] denotes the set {l,2,...,n}. Each r G &([ri\) 
induces a partition r* G &(T) defined by 

r * = {{Xij I % G /?, j G [ji]} I /3 G r}. 

Then we say that n G &(T) is indecomposable if n ^ r* implies r = {[n]}. The following 
result is due to Leonov and Shiryaev in [LSj . 
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Theorem 6. 

* / 31 32 jn 

t£0>(T) \j = i i=i j = i 

where the * indicates the sum is over all indecomposable partitions ofT. 

Proof. (DIE) 

• D (Description): Let 3t(S) be defined as in Theorem HI Choose an indecomposable 
partition r of T. Then, for each j3 G r, we choose an element of ^(/3). Let @*(T) C 
^(T) be the set of these combinatorial objects. We continue to refer to inner and outer 
blocks as in Theorem |H We have the same objects as in H] except the partition forming 
the outer blocks is indecomposable. Then let W and s be defined as in Theorem |H 
Then, similarly to Theorem IH 

* 

£ «(r)= £ s(pWp). 



• I (Involution): Consider p G @*(T). We define an z-split as a pair {Xij, Xi^} that 
belong to different inner blocks of p. Find the smallest i such that there exists an 
z-split, {X it j, X^k}, with j < k. Let fii and /3 2 be the inner blocks containing X it j and 
Xi fa respectively. Now, we perform the same involution as in Theorem H] using these 
blocks. Let / merge the cycles containing Pi and fa if they are not in the same cycle 
and split the cycle containing both if they are in the same cycle. That is, let / map 

(/3iC 1 )(^ 2 C 2 )(C 3 )(C'4) • • ■ (C m ) o (/3iC 1 /? 2 C 2 )(C 3 )(C 4 ) ■ ■ • (C m ). 

where each C r represents any sequence of inner blocks. First, we verify that if / is 
defined for p G @*(T), then f(p) G f^*(T), or that / preserves indecomposability of 
the outer partition of p. We will consider the cases when / merges cycles and splits 
cycles separately. 

If / merges 2 cycles into a single cycle, then the new outer partition is larger under 
the refinement order. So clearly, indecomposability is preserved in this case. 

Otherwise, / splits a single outer block, C, into 2 outer blocks, say C\ and C 2 . Let a 
be the outer partition of p, and let a' be the outer partition of f(p). We know a is 
indecomposable. Suppose that a' ^ r* for some r G ^([n]). So, C\ and C 2 must be 
contained in some block of r*. By definition of /, C% and C 2 both contain an element 
with first index i. Thus, as r* is an induced partition, C\ and C 2 must be contained 
in the same block of r*. Hence, C is also contained in some block of r*. As all other 
blocks of cr are also blocks of a', it follows that a H r* as well. But, because a is 
indecomposable, r = {[n]}. Thus, a' is indecomposable as well. Therefore, / preserves 
indecomposability. 

As before, / is a sign-reversing, weight-preserving involution. 
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E (Exceptions): This involution is denned for any p G @*(T) with an i-split for some 
i, but it fails if we have no such splits. Note that p G 3^*(T) cannot have more 
than one outer block and no splits, because then the outer partition would not be 
indecomposable. Thus, each exception p G @*(T) has outer partition {T}, and for 
each index i, all random variables with first index i must belong to the same inner 
block. So there exists a unique a G ^([w]) for which the set of inner blocks of p, with 
the same cyclic order, is 

{{X hj \ie (3,j e \ji]}\Pe<r}, 

and an exception of this form exists uniquely for every a G ^([n]).The sign and weight 
of each exception p with corresponding o is 



s(p) = (-l)H-i, 
Hence, the total sum reduces to 



0Ea \ie/3 \j=l 



E (-1: 



M-i 



n* n n*. 

/3e<j \ie/9 \j=l 



.11 



J 2 



1 n V| n v2 

vj'=i i =1 



by definition of the Joint Cumulant. 
Therefore, 



_ n 3, 

in a > n v 



T<=&>{T) 



j'=i 



□ 



Let Y be a random variable. Define the conditional joint cumulant as 

<S\Y)= Y, (-l) |Thl (M-l)!lI E (n x Y ) 

It is the same as the joint cumulant except the expectations are conditional. The following 
theorem comes from Brillinger in [B2J. 



Theorem 7. We can generalize the Tower Formula as follows 



(S)= kWi\Y),k(P2\Y),...,k{P\ t \\Y)), 



where the are the blocks of partition r. 
Proof. (DIE) 
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• D (Description): First, we have 



E K(K(Pl\Y),K(fo\Y),...,K(P\ T \\Y)) 

= E E (-i) w -vw. 

re^(S) neV(K(Pi\Y),K(fo\Y),...K(/3\ T \\Y)) 

Here, each n(fa\Y) is a sum over all cyclic arrangments of partitions of fa. So, the 
sum represents partitioning S into blocks which we arrange into inner cycles, and then 
partitioning the set of cycles into outer blocks, which we arrange into an outer cycle. 
But this is equivalent to first partitioning S into outer blocks, which we arrange into 
a cycle, then partitioning the outer blocks into middle blocks, and then partitioning 
each middle block into inner blocks, which we arrange into a cycle. 

Choose a cyclically arranged partition a of S. Then, for each (3 G a, choose an element 
of &{fa). Let Sf(T) be the set of these combinatorial objects. Then, each object 
p G &(S) looks like 




where the black circles are the inner blocks, the cycles of these are the middle blocks, 
and the larger two gray circles are the outer blocks. For p G &(S), we refer to each 
a G p as an outer block, each j3 G a as a middle block, and each 7 G j3 as an inner 
block. Then, distributing, we see that the sum becomes 



j2 (-i)w-i(-i)E- 6 p((E/. 6 «i/»i)-H) jje m ( n x 

So, our set of combinatorial objects is &(S), our sign function is 

s(p) = (_i)H- 1 (_i)Ec iep ((E, 6 J/3|)-l«l) ) 

and our weight function is 



Y 



w <d=n E nn E n* 



Y 
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• I (Involution): Consider p G &(S). Let a>i,...,a m be the outer blocks, ordered by 
increasing minimum index. Consider the smallest i such that ctj contains more than 
one inner block. Let 71, 72, • • • , 7& be the inner blocks of ctj. Then perform the same 
merge- split involution as in the previous proofs on these inner blocks. That is, within 
ctj, let / map 

(7lCl)(72C 2 )(C 3 )(C 4 ) • • • (C r ) <r> (7lC 1 72C 2 )(C , 3)(C 4 ) • • • (C r ) 

where each Cj represents any sequence of inner blocks. As before, / is an involution. 
Here, the weight function 

w(p)=ri E (nn E (n^ 

depends only on the inner and outer blocks. Because / does not change the inner or 
outer blocks, / is weight-preserving. Furthermore, / changes the number of middle 
blocks by ±1 but does not change the number of inner or outer blocks, and we have 
the sign function 

s(p) = (-l)l^l- 1 (-l)E aep ((E /3ec( l/3|)-l«l) ) 

so / is sign-reversing. 

• E (Exceptions): This involution is defined for p G &{S) if and only if there exists an 
outer block containing more than one inner block. Therefore, p is an exception if each 
outer blocks contains only one inner block. So, the set of exceptions has a one-to-one 
correspondence with ^(S), corresponding to choosing the outer blocks and cyclically 
arranging them. Suppose that the outer blocks of p, considering also their cyclic order, 
form the cyclically ordered partition a G 'tf(S). Then exception p has weight and sign 

s(p) = (-i)H- 1 , w(p)=he(e(hx y))=n E (n 

Pea V \xe/3 J J /3ea \xe£ 
by the tower formula. So, the sum totals 



Therefore, 



eV(S) Pea \xep / 



I Y), k{P 2 \Y),..., /c(/3| T | I Y)) = k(S). 

rG^(5) 



□ 
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